statist classif problem statist identifi popul observ belong identifi popul unknown basi train set data observ popul requir individu item group base quantit inform measur trait characterist base train set previous decid group establish problem contrast cluster analysi problem analys singl data set decid observ data set divid group terminolog machin learn classif problem supervis learn cluster unsupervis learn terminolog field applic commun ecolog term classif synonym cluster analysi problem statementth data set train consist inform data point denot gener vector observ characterist data item denot group label label finit number valu classif problem state train data produc rule classifi evalu includ train data group attribut observ specif close true group label train data set true label yi necessarili match sampl approxim observ true label yj unknown prime target classif procedur approxim qualiti approxim judg basi statist probabilist properti popul futur observ drawn edit frequentist proceduresearli work statist classif undertaken fisher context group problem lead fisher linear discrimin function rule assign group observ earli work assum data valu group multivari normal distribut extens context group consid restrict impos classif rule linear work multivari normal distribut allow classifi nonlinear classif rule deriv base slight adjust mahalanobi distanc observ assign group centr lowest adjust distanc observ edit bayesian proceduresunlik frequentist procedur bayesian classif procedur provid natur take account inform rel size popul group popul bayesian procedur tend computation expens dai markov chain mont carlo comput develop approxim bayesian cluster rule devis bayesian procedur involv calcul group membership probabl view provid inform outcom data analysi simpl attribut singl group label observ edit binari multiclass classificationclassif thought separ problem binari classif multiclass classif binari classif understood task class involv multiclass classif involv assign object class classif method develop specif binari classif multiclass classif requir combin multipl binari classifi edit algorithmsth wide classifi neural network multi layer perceptron support vector machin nearest neighbour gaussian mixtur model gaussian naiv bay decis tree rbf classifi exampl classif algorithm includ linear classifi fisher linear discrimin logist regress naiv bay classifi perceptron support vector machin squar support vector machin quadrat classifi kernel estim nearest neighbor boost decis tree random forest neural network bayesian network hidden markov model learn vector quantiz edit evaluationclassifi perform depend greatli characterist data classifi singl classifi work problem phenomenon explain free lunch theorem empir test perform compar classifi perform find characterist data determin classifi perform determin suitabl classifi problem art scienc measur precis recal popular metric evalu qualiti classif system recent receiv oper characterist roc curv evalu tradeoff true fals posit rate classif algorithm intrigu problem pattern recognit solv relationship problem solv data classifi perform pattern recognit algorithm classifi edit applic domainsclassif problem applic emploi data mine procedur detail statist model undertaken comput vision medic imag medic imag analysi optic charact recognit video track drug discoveri develop toxicogenom quantit structur activ relationship geostatist speech recognit handwrit recognit biometr identif biolog classif statist natur languag process document classif internet search engin credit score pattern recognit 